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ABSTRACT: Ethical and legal objections to learning analytics are barriers to development of the 
field, thus potentially denying students the benefits of predictive analytics and adaptive learning. 
Jisc, a charitable organization that champions the use of digital technologies in UK education and 
research, has attempted to address this with the development of a Code of Practice for Learning 
Analytics. The Code covers the main issues institutions need to address in order to progress 
ethically and legally. This paper outlines the extensive research and consultation activities carried 
out to produce a document that covers the concerns of institutions and, critically, the students 
they serve. The resulting model for developing a code of practice includes a literature review, 
setting up appropriate governance structures, developing a taxonomy of the issues, drafting the 
code, consulting widely with stakeholders, as well as publication, dissemination, and embedding it 
in institutions. 


Keywords: Learning analytics, ethics, privacy, legal issues, code of practice 

1 INTRODUCTION 

Ethical and legal issues are almost invariably raised whenever the use of learning analytics is proposed in 
institutions. Concerns are expressed in particular about potential invasions of student privacy arising from 
the misuse of their data, and about the adverse consequences that might arise from monitoring their 
activity and predicting their future academic success. Such issues have become impediments to the 
development and rollout of learning analytics, in some institutions halting the implementation of learning 
analytics completely. The most notorious example is inBloom, an initiative developed with $100 million 
funding from the Gates and Carnegie Foundations, which developed mechanisms for storing large 
amounts of data relating to US schoolchildren and their learning activities. In the post-Snowden era, 
sensitivities around privacy were running high, communications were badly handled, and families and 
privacy advocates ultimately forced the closure of the programme (K.N.C., 2014). 

Soon afterwards, Facebook's famous "mood experiment" placed positive and negative items and images 
in the timelines of 700,000 users to find out if these would affect users' moods. This resulted in a huge 
backlash from users and extensive negative media coverage, forcing changes to Facebook's research 
methods and policies (Shroepfer, 2014). While concerns about privacy, data protection, and ethics raised 
by students and staff at educational institutions are generally valid and must be addressed, the ensuing 
hiatus means that learners are being denied the potential benefits of learning analytics that can help to 
identify areas for improvement and ultimately make the difference between completing their course and 
dropping out. 

Using personal data to present analytics and inform interventions that may significantly affect students' 
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lives does, of course, bring with it serious responsibilities. King and Richards (2014) argue that we are in a 
critical window and that whatever ethical practices are established now in the field of big data will affect 
notions of acceptability for years to come. The sheer amount of data that can now be collected on 
individuals, and the insight that can be gained from its analysis, enable far more to be learnt about people 
than was ever anticipated (PCAST, 2014). Algorithms now exist that can discover things about you before 
you know them yourself. The implications for the privacy of learners, and the potential for misuse of the 
data collected and the analytics performed on it, necessitate the use of carefully considered policies that 
help institutions to act ethically, stay within the law, and minimize adverse impacts on individuals. Such 
frameworks, however, should not unnecessarily hold up the progress being made in the field of learning 
analytics that promises real benefits for students and institutions. 

Educational researchers have been arguing for some time for the need for a set of principles or a code of 
ethics as the field of learning analytics develops. Ferguson (2012) recommends an ethical framework to 
help institutions make decisions regarding the ownership and stewardship of learners' data. However, 
Pardo and Siemens (2014) suggest this will be difficult as institutions already struggle to define privacy 
policies in other areas. Berg (2013) believes that without a code of ethics, institutions may carry out 
analytics in arbitrary ways, thus reducing consistency and fair treatment for students. He proposes that 
such a document would help to alleviate differences in approaches to dealing with analytics by teachers 
and senior managers. Add into the mix the viewpoint of students who may not wish to have their personal 
data collected, let alone acted upon through an "intervention," and you have a toxic mix of expectations 
— unless common understanding can be achieved through mutually agreed policies. Indeed, without 
addressing the ethical issues, users (both employees and students) may actively resist the introduction of 
learning analytics (Greller & Drachsler, 2012; Siemens, 2012). 

Students are increasingly accustomed to having their data collected by commercial organizations or 
government agencies for arguably far more intrusive purposes than learning analytics. They may therefore 
show little resistance to the collection and use of their data by trusted educational institutions for the 
purposes of enhancing their education. However, developing a clearly articulated set of principles to 
handle student data and any interventions appropriately can be a preventative measure, pre-empting 
backlashes from users such as those experienced by InBloom and the Facebook mood experiment. It has 
been noted too that employees usually prefer to work for organizations committed to ethical standards, 
and that consumers like to buy from companies with "strong records of adherence to standards of conduct 
and socially sensitive behavior" (PABC, 2007). It is likely that employees and students of educational 
institutions are no different in this regard; arguably, universities and colleges have an even stronger 
imperative to act ethically and legally for the benefit of learners, and to demonstrate clearly how they are 
doing so. 

Transparency is key here: it is in the interests of students, staff, and institutions that the uses to which 
learning analytics will be put are explained as clearly as possible. There is a risk, as Slade & Prinsloo (2013) 
point out, that learning analytics will fail to be adopted successfully unless perceptions are managed 
carefully. Other industries have already developed codes of practice for the use of data and analytics, as 
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have various professions and communities of practice within education. It is worth examining the benefits 
to organizations listed by the UK Information Commissioner's Office of following its code of practice for 
personal information online (ICO, 2010): 

• Greater trust and a better relationship with the people you collect information about 

• Reduced reputational risk caused by the inappropriate or insecure processing of personal data 

• Better take-up of online services, meaning economic savings and greater convenience for 
customers 

• Minimized risk of breaches and consequent enforcement action by the Information Commissioner 
or other regulators 

• Gaining a competitive advantage by reassuring the people you deal with that you take their 
privacy seriously 

• Increasing people's confidence to provide more valuable information, because they are reassured 
that it will be used properly and kept securely, and 

• Reduced risk of questions, complaints and disputes about your use of personal data. 

Jisc, the organization responsible for many aspects of IT infrastructure and learning technology in UK 
higher and further education, has been leading an initiative to promote the effective use of learning 
analytics (Sclater, 2014a). Working closely with stakeholders as part of a "co-design" process, 1 tackling 
issues relating to privacy and ethics was identified early on as a priority. It was felt that a Code of Practice 
for Learning Analytics (Sclater & Bailey, 2015) was essential in order for progress to be made. This would 
identify the main legal and ethical barriers to progress and suggest ways for institutions to overcome 
them. 

The development of Jisc's Code of Practice has involved five stages: 

1. An extensive literature review of the legal and ethical issues around learning analytics 

2. The formation of an advisory group to oversee the development of the Code of Practice 

3. The development of a taxonomy of ethical, legal, and logistical issues — and its validation with 
national and international experts 

4. The drafting of the Code of Practice — and its validation with stakeholders across the sector 

5. The population of an accompanying website with further guidance and case studies. 

This paper discusses how these stages have contributed to a code of practice informed by the literature 
and by experts in the field, achieving consensus through extensive consultation, and the involvement of 
students. It also defines a model for this process and briefly outlines how this could be used for the 
development of other codes of practice. 


1 "Co-design" is Jisc's collaborative technology innovation model that uses customer priorities to identify new opportunities and 
address pressing issues in education. 
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2 CARRYING OUT THE LITERATURE REVIEW 


For the literature review (Sclater, 2014b), publications from many different authors and organizations 
were gathered. Material was drawn from eighty-six documents, more than a third of them published 
within the preceding year, from sources including: 


• The literature around learning analytics that makes explicit reference to legal and ethical issues 

• Articles and blogs around the ethical and legal issues of big data 

• A few papers that concentrate specifically on privacy 

• Relevant legislation, in particular the European Data Protection Directive 1995 and the UK Data 
Protection Act 1998 

• Related codes of practice from education and industry 


Expressing issues as questions can be a useful way of making complex issues more concrete. Ninety-three 
questions from the literature that authors had posed directly were incorporated. The categorizations of 
these highlighted in the word cloud shown in Figure 1 give an instant flavour of the main concerns around 
the implementation of learning analytics being raised by researchers and practitioners. 


■ -interventions 


Stewardship-of-data 

TramparfiK^-anHmd-aljoriihms-and-melrics 


a i •interventions 1 

Uwnership-and- 

student-responsibility | Personal-circumstances 

(Jbligation-to-act 


Impacts-on-student-behaviour 



Opting-out 


Interpretation 


Awareness 


Figure 1: Main concerns in the literature around learning analytics as identified by Sclater (2014b). 


At the end of the literature review, sixteen codes of practice and lists of ethical principles from related 
fields were reviewed. It was found that the main concepts their authors attempted to embody were 
transparency, clarity, respect, user control, consent, access, and accountability — all of which are highly 
relevant and correspond with the concerns being raised by researchers and practitioners in the field of 
learning analytics. 

3 DELIBERATIONS OF THE ADVISORY GROUP 

An important part of the process for developing the Code was the formation of an advisory group with 
fifteen members from the higher and further education sectors (Sclater, 2015a). The group included a pro 
vice-chancellor, academics with expertise in policy, ethics, and learning analytics, senior IT staff, a legal 
expert, and a representative from the UK's National Union of Students (NUS). 2 Members were able to 
advise on the approach to producing the Code, the areas to be covered, ways to gain further validation 

2 The institutions represented were Croydon College, Edinburgh University, Huddersfield University, Lancaster 
University, London South Bank University, Loughborough University, Jisc, National Union of Students, and The 
Open University. 
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from the community, dissemination and adoption. It was agreed that the main purpose of the Code would 
be to help remove barriers to the adoption of learning analytics, and that it should provide a focus for 
institutions to deal with the many legal and ethical hurdles that they were encountering. Alongside a 
concise summary document, the guidance could be presented as an evolving, dynamic site rather than a 
lengthy one-off document that would be less likely to be read, let alone adhered to. Members also agreed 
to critique the Code as it was being developed and to consider piloting it at their own institutions. 

3.1 Methodology and Approaches 

Some documents of this nature take a particular methodological or philosophical stance. For instance, 
Slade and Prinsloo's (2013) socio-critical approach — where learning analytics is viewed as a "transparent 
moral practice" and students are seen as co-contributors — has influenced the Open University's Policy 
on Ethical Use of Student Data (Open University, 2014). The advisory group suggested that the Code's 
emphasis would be "positive, realistic and facilitative" and that it should emphasize that learning analytics 
is primarily for the benefit of students. 

The group considered that one of the main challenges of developing the Code would be to strike a balance 
between a paternalistic approach and respecting students' privacy and autonomy. An approach that put 
the needs of learners at the heart of the Code was thought likely to result in a better, more widely adopted 
document and help to allay the fears of students and institutions, hence facilitating the uptake of learning 
analytics. The inclusion of the NUS in this group was therefore particularly welcome. 

Would a separate code of practice or "bill of rights for learning analytics" owned by and for students help 
to gain acceptance? Or could this diverge so much from the one representing institutional concerns that 
it would exacerbate the differences and create conflict? Combining all interests in one document would 
require a balanced approach and a series of compromises but hopefully encourage mutual understanding, 
result in a usable Code, and move the field of learning analytics forward collaboratively. 

The advisory group concluded that a single document clearly setting out the rights and responsibilities of 
students, institutions, and staff would be preferable. Explaining what the Code means in practice however 
would require separate advice for different stakeholders. At institutions, the Code should ideally link 
closely with documents such as the student charter, and ensure buy-in from the student union. 

Another issue raised was whether the Code could be at a sufficiently high level to meet the needs of all 
institutions while remaining specific enough to provide genuinely helpful guidance. Researchers and 
senior managers with responsibility for implementing learning analytics at a range of institutions had been 
approached earlier to review the development of learning analytics at their institutions (Sclater, 2014d). 
From a series of semi-structured interviews, it had become clear that the potential uses of learning 
analytics and the concerns raised varied widely across institutions. The advisory group thought that the 
Code should be fairly high level in order to prove useful to all, but should be backed up by case studies 
and examples of how institutions have dealt with particular issues. The case studies could be presented 
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alongside the Code — for each principle, there could be examples of good practice. 

Another question raised was whether institutions should be encouraged to adopt the Code wholesale, 
and therefore be able to claim conformance with it, or to use it more as a checklist of issues to be 
considered and customized to fit their own institutional policies. The latter approach seemed more likely, 
and several universities have already suggested that they will use it as the basis for their own learning 
analytics policies. 

Particular concern was expressed that the Code must reflect the human context and the need for 
intermediation of learning analytics by staff. This is a common ethical theme in the literature. However, a 
representative from The Open University said that the sheer scale of that institution makes it unfeasible 
to use human intermediation for many of the potential uses of learning analytics. Meanwhile there was a 
strong recommendation that the language used to present analytics to students should be carefully 
considered and that data should only be exposed when institutions have mechanisms in place to deal with 
the effect on students. The potential impact of analytics on the educator also needed to be reflected in 
the Code. 

3.2 An Appropriate Format for the Code of Practice 

Most codes of practice are textual documents, normally provided in PDF. The members felt that a 
document outlining the principles needed to be provided in order to present it to institutional committees 
but that an interactive website containing case studies, perhaps in the form of videoed interviews with 
staff and students, would be welcome. 

Many codes of practice or "codes of ethics" are extremely lengthy and somewhat uninspiring papers 
stretching to thirty pages or more. One of the more readable examples is the Respect Code of Practice for 
Socio-Economic Research (RESPECT Project, 2004). It is concise — only four pages — and reasonably 
visually appealing, therefore arguably more likely to be read and absorbed by busy people than some of 
the longer codes. However, given the large number of issues identified in the literature review, four pages 
were thought unlikely to be sufficient. 

The agreed approach was to back up a concise summary document with more detailed online guidance 
for each of the areas. The literature review covers most of the ethical and legal issues likely to be of 
concern to students and to institutions when deploying learning analytics; the word clouds in the review 
could help prioritize the main areas to be included in the document. Supporting content — e.g., videoed 
interviews — could be developed subsequently, assist in raising awareness of the Code, provide examples 
of how it is being implemented, and help to keep it up to date. Discussion forums could be included on 
each topic, enabling users to raise further issues, and others to provide advice on how they have tackled 
that challenge. This would need some ongoing promotion, facilitation, and moderation by Jisc and/or 
members of the community. 
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3.3 Dissemination and Rollout 

A sense of ownership by institutions and by students was considered essential to ensure adoption. How 
could this best be achieved? A range of stakeholder organizations was proposed for consultation and a 
number of possible events to piggyback on were proposed as dissemination opportunities. Several 
members said they would be keen to try piloting the Code at their institutions too. It was also suggested 
that vendors should be included in the consultation process. It might help them when making 
development decisions, encouraging them for instance to build consent systems into their products. The 
Code could help to ensure that safeguards, such as ensuring privacy, are incorporated without holding 
back innovation. 

One member of the advisory group suggested that it would be useful to better understand the processes 
inside institutions for getting academic policies adopted, as this would be key to uptake. In addition, some 
events specifically around the Code could be held, and papers delivered at relevant conferences. It was 
felt that the Code should be launched with some fanfare at a larger event to increase awareness and 
potential take-up. 

4 DEFINING AND VALIDATING A TAXONOMY OF ETHICAL, LEGAL, AND 
LOGISTICAL ISSUES 

A few events have centred around issues of ethics and privacy in learning analytics, notably a workshop 
organized by LACE and SURF in Utrecht, Netherlands, in October 2014 (Sclater, 2014c) and a pre¬ 
conference event with peer-reviewed submissions at the Learning Analytics and Knowledge Conference 
(LAK '15) in Poughkeepsie, USA. 3 In such discussions at conferences and within institutions, the same 
issues are continually raised but have generally already been covered somewhere in the growing 
collection of publications on learning analytics. Sometimes the issue is expressed differently but boils 
down to the same underlying problem. The literature review produced for the Code of Practice (Sclater, 
2014b) is a large and unwieldy document, so the issues and questions detailed in it were distilled from 
the text line by line into a more succinct tabular format. The word clouds in the literature review were 
used as a basis for grouping the issues. 

The resulting taxonomy in Table 1 includes eighty-six distinct issues (Sclater, 2015c). Each is given a name 
and expressed as a question that attempts to capture the issue concisely. Many of the questions cannot 
of course be answered simply; almost all could be responded to with "It depends..." An attempt was made 
to classify them as either primarily ethical or primarily legal in nature. Most have both an ethical and a 
legal dimension; as laws are often underpinned by ethics, this is not surprising. While some were referred 
to in the literature as ethical issues, they were however related more to the logistics of carrying out 
learning analytics in institutions than doing what's ethically right or keeping within the law. Thus, what 
started out as a collection of ethical and legal issues became a list incorporating a number of logistical 


Details of the event are at http://www.laceproject.eu/ethics-privacy-learning-analytics/ 
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issues as well. 

Jisc, Apereo Foundation, and the LACE Project held a workshop in Paris in February 2015 (Sclater, 2015b) 
to discuss the ethical and legal issues of learning analytics, focusing on the draft taxonomy. Twelve 
participants from France, Germany, the Netherlands, and the UK, primarily from academic backgrounds, 
worked together to validate and refine the list of issues and comment on the approach. As a result, the 
taxonomy in Table 1 was re-ordered to reflect a lifecycle view of learning analytics, moving from issues of 
ownership and control to seeking consent from students, encouraging transparency, maintaining privacy, 
ensuring validity in the data and the analytics, enabling student access to the data, carrying out 
interventions appropriately, minimizing adverse impacts, and stewarding the data. 

The Paris workshop group suggested scoring the issues based on their importance and started the process 
of rating them on a scale of 1 to 5, highlighting the most important ones. The scale was subsequently 
reduced to three points, roughly equating to 1) Critical, 2) Important, 3) Less important or may not arise. 
The ratings are the subjective view of the group and the author based on their expertise and experience. 
A more rigorous way of rating the issues, seeking wider input, might have been helpful though the ranking 
will always be dependent on the nature and priorities of the institution and its staff and students. 

The group also added a stakeholder column. The problem with this was the significant difference between 
the stakeholders most impacted and those responsible for dealing with the issue. Which should be 
included in the column? The most impacted stakeholders were usually students so the column turned out 
not to be particularly helpful. Thus, a responsibility column was included instead, showing who is primarily 
responsible for dealing with the issue. While this may help institutions to assign responsibility, again, there 
is a level of subjectivity here and these roles will be constituted differently depending on the institution. 
The six types of stakeholder with primary responsibility for dealing with the issues are categorized as 
follows: 

1. Senior management — the executive board of the institution. 

2. Analytics committee — the group responsible for strategic decisions regarding learning analytics. 
This might be a learning and teaching committee, though some of the issues may be the 
responsibility of a senior champion of learning analytics rather than a more representative 
committee. 

3. Data scientist — while the analytics committee may decide on particular issues, there is a need 
for data scientists or analysts to advise on issues relating to the validity of the dataset and how to 
interpret it. 

4. Educational researcher — some issues would be best dealt with by staff with detailed knowledge 
of the educational aspects who are able to monitor the impact of analytics on students. This role 
may be carried out by teachers or tutors or those more dedicated to educational research. 

5. IT — the institutional information technology department will take primary responsibility for 
some aspects of the analytics processes. 

6. Student — while students are potentially impacted by almost every issue here, they are primarily 
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responsible themselves for dealing with a few of them. 


Table 1: A taxonomy of ethical, legal, and logistical issues for learning analytics. 


GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 

Ownership & 

Control 

Overall 

responsibility 

Who in the institution is responsible for the 
appropriate and effective use of learning 
analytics? 

Logistical 

1 

Senior 

management 


Control of data for 

analytics 

Who in the institution decides what data is 

collected and used for analytics? 

Logistical 

1 

Senior 

management 


Breaking silos 

How can silos of data ownership be broken 
in order to obtain data for analytics? 

Logistical 

2 

Analytics 

committee 


Control of analytics 

processes 

Who in the institution decides how 

analytics are to be created and used? 

Logistical 

1 

Analytics 

committee 


Ownership of data 

How is ownership of data assigned across 

stakeholders? 

Legal 

1 

Analytics 

committee 

Consent 

When to seek 

consent 

In which situations should students be 

asked for consent to the collection and use 

of their data for analytics? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Consent for 

anonymous use 

Should students be asked for consent for 

the collection of data that will only be used 
in anonymized formats? 

Legal/ 

Ethical 

3 

Analytics 

committee 


Consent for 

outsourcing 

Do students need to give specific consent if 
the collection and analysis of data is to be 
outsourced to third parties? 

Legal 

3 

Analytics 

committee 


Clear and 

meaningful consent 

processes 

How can institutions avoid opaque privacy 
policies and ensure that students genuinely 
understand the consent they are asked to 
give? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Right to opt out 

Do students have the right to opt out of 
data collection and analysis of their 
learning activities? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Right to withdraw 

Do students have the right to withdraw 
from data collection and analysis after 
previously giving their consent? 

Legal 

3 

Analytics 

committee 


Right to anonymity 

Should students be allowed to disguise 
their identity in certain circumstances? 

Ethical/ 

Logistical 

3 

Analytics 

committee 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Adverse impact of 

opting out on 

individual 

If a student is allowed to opt out of data 
collection and analysis, could this have a 
negative impact on their academic 
progress? 

Ethical 

1 

Analytics 

committee 


Adverse impact of 

opting out on group 

If individual students opt out, will the 
dataset be incomplete, thus potentially 
reducing the accuracy and effectiveness of 
learning analytics for the group? 

Ethical/ 

Logistical 

1 

Data scientist 


Lack of real choice 

to opt out 

Do students have a genuine choice if 
pressure is put on them by the institution 
or if they feel their academic success may 
be impacted by opting out? 

Ethical 

3 

Analytics 

committee 


Student input to 
analytics process 

Should students have a say in what data is 
collected and how it is used for analytics? 

Ethical 

3 

Analytics 

committee 


Change of purpose 

Should institutions request consent again if 
the data is to be used for purposes for 
which consent was not originally given? 

Legal 

2 

Analytics 

committee 


Legitimate interest 

To what extent can the institution's 

"legitimate interests" override privacy 

controls for individuals? 

Legal 

2 

Analytics 

committee 


Unknown future 

uses of data 

How can consent be requested when 
potential future uses of the (big) data are 
not yet known? 

Logistical 

3 

Analytics 

committee 


Consent in open 

courses 

Are open courses (MOOCs, etc.) different 
when it comes to obtaining consent? 

Legal/ 

Ethical 

2 

Analytics 

committee 


Use of publicly 

available data 

Can institutions use publicly available data 
(e.g., tweets) without obtaining consent? 

Legal/ 

Ethical 

3 

Analytics 

committee 

Transparency 

Student awareness 

of data collection 

What should students be told about the 

data being collected about them? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Student awareness 

of data use 

What should students be told about the 

uses to which their data is being put? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Student awareness 

of algorithms and 

metrics 

To what extent should students be given 
details of the algorithms used for learning 
analytics and the metrics and labels 

created? 

Ethical 

2 

Analytics 

committee 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Proprietary 
algorithms and 

metrics 

What should institutions do if vendors do 

not release details of their algorithms and 

metrics? 

Logistical 

3 

Analytics 

committee 


Student awareness 

of potential 
consequences of 

opting out 

What should students be told about the 

potential consequences of opting out of 
data collection and analysis of their 
learning? 

Ethical 

2 

Analytics 

committee 


Staff awareness of 

data collection and 

use 

What should teaching staff be told about 
the data being collected about them, their 
students, and what is being done with it? 

Ethical 

1 

Analytics 

committee 

Privacy 

Out of scope data 

Is there any data that should not be used 
for learning analytics? 

Ethical 

2 

Analytics 

committee 


Tracking location 

Under what circumstances is it appropriate 

to track the location of students? 

Ethical 

2 

Analytics 

committee 


Staff permissions 

To what extent should access to student 

data be restricted within an institution? 

Ethical/ 

Logistical 

1 

Analytics 

committee 


Unintentional 

creation of sensitive 

data 

How do institutions avoid creating 
"sensitive" data, e.g., religion, ethnicity, 

from other data? 

Legal/ 

Logistical 

2 

Data scientist 


Requests from 
external agencies 

What should institutions do when requests 
for student data are made by external 
agencies, e.g., educational authorities or 
security agencies? 

Legal/ 

Logistical 

2 

Senior 

management 


Sharing data with 

other institutions 

Under what circumstances is it appropriate 

to share student data with other 

institutions? 

Legal/ 

Ethical 

2 

Analytics 

committee 


Access to employers 

Under what circumstances is it appropriate 
to give employers access to analytics on 

students? 

Ethical 

2 

Analytics 

committee 


Enhancing trust by 
retaining data 
internally 

If students are told that their data will be 

kept within the institution, will they 
develop greater trust in and acceptance of 
analytics? 

Ethical 

3 

Analytics 

committee 


Use of metadata to 

identify individuals 

Can students be identified from metadata 

even if personal data has been deleted? 

Legal/ 

Logistical 

2 

Data scientist 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Risk of re¬ 
identification 

Does anonymization of data become more 
difficult as multiple data sources are 
aggregated, potentially leading to re¬ 
identification of an individual? 

Legal/ 

Logistical 

1 

Data scientist 

Validity 

Minimization of 

inaccurate data 

How should an institution minimize 

inaccuracies in the data? 

Logistical 

2 

Data scientist 


Minimization of 

incomplete data 

How should an institution minimize 

incompleteness of the dataset? 

Logistical 

2 

Data scientist 


Optimum range of 

data sources 

How many and which data sources are 
necessary to ensure accuracy in the 
analytics? 

Logistical 

2 

Data scientist 


Validation of 

algorithms and 

metrics 

How should an institution validate its 

algorithms and metrics? 

Ethical/ 

Logistical 

1 

Data scientist 


Spurious 

correlations 

How can institutions avoid drawing 
misleading conclusions from spurious 

correlations? 

Ethical/ 

Logistical 

2 

Data scientist 


Evolving nature of 

students 

How accurate can analytics be when 

students' identities and actions evolve over 

time? 

Logistical 

3 

Educational 

researcher 


Authentication of 

public data sources 

How can institutions ensure that student 

data taken from public sites is 

authenticated to their students? 

Logistical 

3 

IT 

Access 

Student access to 

their data 

To what extent should students be able to 

access the data held about them? 

Legal 

1 

Analytics 

committee 


Student access to 

their analytics 

To what extent should students be able to 

access the analytics performed on their 

data? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Data formats 

In what formats should students be able to 

access their data? 

Logistical 

2 

Analytics 

committee 


Metrics and labels 

Should students see the metrics and labels 

attached to them? 

Ethical 

2 

Analytics 

committee 


Right to correct 

inaccurate data 

What data should students be allowed to 

correct about themselves? 

Legal 

1 

Analytics 

committee 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Data portability 

What data about themselves should 

students be able to take with them? 

Legal 

2 

Analytics 

committee 

Action 

Institutional 

obligation to act 

What obligation does the institution have 

to intervene when there is evidence that a 

student could benefit from additional 

support? 

Legal/ 

Ethical 

1 

Analytics 

committee 


Student obligation 

to act 

What obligation do students have when 
analytics suggests actions to improve their 
academic progress? 

Ethical 

2 

Student 


Conflict with study 
goals 

What should a student do if the suggestions 
are in conflict with their study goals? 

Ethical 

3 

Student 


Obligation to 

prevent 

continuation 

What obligation does the institution have 
to prevent students from continuing on a 
pathway that analytics suggests is not 

advisable? 

Ethical 

2 

Analytics 

committee 


Type of intervention 

How are the appropriate interventions 

decided on? 

Logistical 

1 

Educational 

researcher 


Distribution of 

interventions 

How should interventions be distributed 

across the institution? 

Logistical 

1 

Analytics 

committee 


Conflicting 

interventions 

How does the institution ensure that it is 

not carrying out multiple interventions with 
conflicting purposes? 

Logistical 

2 

Educational 

researcher 


Staff incentives for 

intervention 

What incentives are in place for staff to 
change practices and facilitate 

intervention? 

Logistical 

3 

Analytics 

committee 


Failure to act 

What happens if an institution fails to 
intervene when analytics suggests that it 

should? 

Logistical 

3 

Analytics 

committee 


Need for human 

intermediation 

Are some analytics better presented to 
students via a tutor than a system? 

Ethical 

2 

Educational 

researcher 


Triage 

How does an institution allocate resources 

for learning analytics appropriately for 
learners with different requirements? 

Ethical/ 

Logistical 

1 

Analytics 

committee 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Triage transparency 

How transparent should an institution be in 

how it allocates resources to different 

groups? 

Ethical 

3 

Analytics 

committee 


Opportunity cost 

How is spending on learning analytics 
justified in relation to other funding 
requirements? 

Logistical 

2 

Senior 

management 


Favouring one 
group over another 

Could the intervention strategies unfairly 
favour one group over another? 

Ethical/ 

Logistical 

2 

Educational 

researcher 


Consequences of 

false information 

What should institutions do if a student 

gives false information, e.g., to obtain 
additional support? 

Logistical 

3 

Analytics 

committee 


Audit trails 

Should institutions record audit trails of all 

predictions and interventions? 

Logistical 

2 

Analytics 

committee 


Unexpected findings 

How should institutions deal with 

unexpected findings arising in the data? 

Logistical 

3 

Analytics 

committee 

Adverse 

impact 

Labelling bias 

Does labelling or profiling students bias 
institutional perceptions and behaviours 

towards them? 

Ethical 

1 

Educational 

researcher 


Oversimplification 

How can institutions avoid overly simplistic 
metrics and decision making that ignore 
personal circumstances? 

Ethical 

1 

Educational 

researcher 


Undermining of 

autonomy 

Is student autonomy in decision making 
undermined by predictive analytics? 

Ethical 

2 

Educational 

researcher 


Gaming the system 

If students know that data is being 
collected about them, will they alter their 
behaviour to present themselves more 
positively, thus distracting them and 
skewing the analytics? 

Ethical 

2 

Educational 

researcher 


Abusing the system 

If students understand the algorithms, will 
they manipulate the system to obtain 
additional support? 

Ethical 

3 

Educational 

researcher 


Adverse behavioural 

impact 

If students are presented with data about 
their performance, could this have a 
negative impact e.g., increased likelihood of 
dropout? 

Ethical 

1 

Educational 

researcher 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Reinforcement of 

discrimination 

Could analytics reinforce discriminatory 
attitudes and actions by profiling students 
based on their race or gender? 

Ethical 

1 

Educational 

researcher 


Reinforcement of 

social power 

differentials 

Could analytics reinforce social power 

differentials and students' status in relation 

to each other? 

Ethical 

2 

Educational 

researcher 


Infantilization 

Could analytics "infantilize" students by 
spoon-feeding them with automated 
suggestions, making the learning process 
less demanding? 

Ethical 

3 

Educational 

researcher 


Echo chambers 

Could analytics create "echo chambers" 
where intelligent software reinforces our 

own attitudes and beliefs? 

Ethical 

3 

Educational 

researcher 


Non-participation 

Will the knowledge that they are being 
monitored lead to non-participation by 

students? 

Ethical 

2 

Educational 

researcher 

Stewardship 

Data minimization 

Is all the data held on an individual 

necessary in order to carry out the 
analytics? 

Legal 

1 

Data scientist 


Data processing 

location 

Is the data being processed in a country 
permitted by the local data protection 

laws? 

Legal 

1 

IT 


Right to be 
forgotten 

Can all data regarding an individual (except 
that necessary for statutory purposes) be 

deleted? 

Legal 

1 

IT 


Unnecessary data 

retention 

How long should data be retained? 

Legal 

1 

Analytics 

committee 


Unhelpful data 

deletion 

If data is deleted, does this restrict the 
institution's analytics capabilities, e.g., 
refining its models and tracking 
performance over multiple cohorts? 

Logistical 

2 

Data scientist 


Incomplete 
knowledge of data 

sources 

Can an institution be sure that it knows 

where all personal data is held? 

Legal/ 

Logistical 

1 

IT 
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GROUP 

NAME 

QUESTION 

TYPE 

RANK 

RESPONSIBILITY 


Inappropriate data 
sharing 

How can data sharing be prevented with 
parties who have no legitimate interest in 
seeing it or who may use it inappropriately? 

Legal 

1 

IT 


5 DRAFTING THE CODE OF PRACTICE 

After the taxonomy was made available on the project blog, and with further in-depth feedback from 
members of the advisory group, it proved relatively easy to draft the Code of Practice using the taxonomy 
as its basis. All those issues with a priority level of 1 or 2 were incorporated into the Code. Given the brief 
nature of the summary document, guidance in how to deal with the issues is by necessity at a basic level, 
but, as stated earlier, more in-depth advice and case studies will be included in an accompanying website, 
which is under development. 

5.1 Introduction 

The Code is grouped into eight areas, based on the categories in the taxonomy, and preceded by an 
introduction that emphasises two of the key themes of the Code, i.e., that learning analytics should be for 
the benefit of students, and that it should be carried out transparently. It also notes that many of the 
processes of learning analytics, particularly in the area of data protection, should be covered by existing 
institutional policies. 

Learning analytics uses data about students and their activities to help institutions understand 
and improve educational processes, and provide better support to learners. 

It should be for the benefit of students, whether assisting them individually or using aggregated 
and anonymized data to help other students or to improve the educational experience more 
generally. It is distinct from assessment, and should be used for formative rather than summative 
purposes. 

The effective use of learning analytics will initially involve the deployment of new systems, and 
changes to institutional policies and processes. New data may be collected on individuals and their 
learning activities. Analytics will be performed on this data, and interventions may take place as a 
result. This presents opportunities for positive engagements and impacts on learning, as well as 
misunderstandings, misuse of data and adverse impacts on students. 

Complete transparency and clear institutional policies are therefore essential regarding the 
purposes of learning analytics, the data collected, the processes involved, and how they will be 
used to enhance the educational experience. 

This code of practice aims to set out the responsibilities of educational institutions to ensure that 
learning analytics is carried out responsibly, appropriately and effectively, addressing the key legal, 
ethical and logistical issues which are likely to arise. 

Educational institutions in the UK already have information management practices and procedures 
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in place and have extensive experience of handling sensitive and personal data in accordance with 
the Data Protection Act (DPA) 1998. 

By transferring and adapting this expertise to regulate the processing of data for learning analytics, 
institutions should establish the practices and procedures necessary to process the data of 
individuals lawfully and fairly. 

5.2 Responsibility 

The next section aims to make it clear that responsibility in the institution for the various processes of 
learning analytics needs to be allocated appropriately and that students and other stakeholders should 
be consulted. 

Institutions must decide who has overall responsibility for the legal, ethical, and effective use of 
learning analytics. They should allocate specific responsibility within the institution for: 

• The collection of data to be used for learning analytics 

• The anonymisation of the data where appropriate 

• The analytics processes to be performed on the data, and their purposes 

• The interventions to be carried out 

• The retention and stewardship of data used for and generated by learning analytics 

Student representatives and key staff groups at institutions should be consulted around the 
objectives, design, development, roll-out and monitoring of learning analytics. 

5.3 Transparency and Consent 

The next part of the Code is about being open about all aspects of the use of learning analytics, and 
ensuring that students provide meaningful, informed consent. The area of requesting consent is not 
straightforward, as the UK Data Protection Act (1998), derived from the European Data Protection 
Directive (European Commission, 1995), does not always require obtaining consent, for example, when 
data collection is necessary for the "legitimate interests" of an organization. Meanwhile a balance must 
be struck between obtaining meaningful consent for learning analytics but not bombarding students with 
continual requests for permission on every aspect of data collection and use. The consensus of the 
advisory group and various experts consulted was that obtaining consent for interventions to be taken 
based on a student's data is key. Allowing students to opt-out of data collection may, in some cases, make 
the carrying out of normal educational processes impossible; for example, virtual learning environments 
collect data on student activity by default and cannot function without doing so. 

Institutions will define the objectives for the use of learning analytics, what data is necessary to 
achieve these objectives, and what is out of scope. The data sources, the purposes of the analytics, 
the metrics used, who has access to the analytics, the boundaries around usage, and how to 
interpret the data will be explained clearly to staff and students. 

Institutions should also clearly describe the processes involved in producing the analytics to 
students and staff or make the algorithms transparent to them. 
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Students will normally be asked for their consent for personal interventions to be taken based on 
the learning analytics. This may take place during the enrolment process or subsequently. There 
may however be legal, safeguarding or other circumstances where students are not permitted to 
opt out of such interventions. If so these must be clearly stated and justified. 

New learning analytics projects may not be covered by the institution's existing arrangements. 
Collection and use of data for these may require further measures, such as privacy impact 
assessments and obtaining additional consent. 

Options for granting consent must be clear and meaningful, and any potential adverse 
consequences of opting out must be explained. Students should be able easily to amend their 
decisions subsequently. 

5.4 Privacy 

The Code here emphasizes that access to student data should be carefully controlled and data protection 
legislation complied with. There is doubt as to whether in the age of Big Data it is ever possible to 
anonymize an individual's data such that they cannot be re-identified at some stage (e.g., Bollier, 2010), 
but institutions should make every effort to do so if an individual's data is to be used anonymously. 
Meanwhile, any sharing of data outside the institution should be made clear to students and staff. It was 
also felt to be important to state that institutions may have legal obligations to override privacy 
restrictions, for example, when analytics identify a student who appears to be at risk of suicide. 

Access to student data and analytics should be restricted to those identified by the institution as 
having a legitimate need to view them. 

Where data is to be used anonymously particular care will be taken by institutions to avoid: 

• Identification of individuals from metadata 

• Re-identification of individuals by aggregating multiple data sources 

The use of "sensitive data" (as defined by the DPA), such as religious affiliation and ethnicity, for 
the purposes of learning analytics requires additional safeguards. Circumstances where data and 
analytics could be shared externally — e.g., requests from educational authorities, security 
agencies or employers — will be made explicit to staff and students, and may require additional 
consent. 

Institutions should ensure that student data is protected when contracting third parties to store 
data or carry out learning analytics on it. 

Institutions may have a legal obligation to intervene, and hence override some privacy restrictions, 
where data or analytics reveal that a student is at risk. Such circumstances should be clearly 
specified. 

5.5 Validity 

Predictive analytics are worthless unless the data is accurate and the algorithms are valid. For this reason, 
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it was thought important ethically, and potentially legally too, that expertise existed in the institution to 
ensure that the analytics processes, which could affect students' careers and lives, were understood. 
Meanwhile, it is stressed that even if the analytics is valid it needs to be seen in the wider context of an 
individual's experience. 

It is vital that institutions monitor the quality, robustness and validity of their data and analytics 
processes in order to develop and maintain confidence in learning analytics and ensure it is used 
to the benefit of students. Institutions should ensure that: 

• Inaccuracies in the data are understood and minimised 

• The implications of incomplete datasets are understood 

• The optimum range of data sources is selected 

• Spurious correlations are avoided 

All algorithms and metrics used for predictive analytics or interventions should be understood, 
validated, reviewed and improved by appropriately qualified staff. 

Data and analytics may be valid but should also be useful and appropriate; learning analytics 
should be seen in its wider context and combined with other data and approaches as appropriate. 

5.6 Access 

Few institutions are yet in a position to provide a student with a copy of all the data held about them 
(including the analytics performed on their data, which, also, is itself data). However, individuals in Europe 
do have a legal right to request this information, and institutions must work to facilitate this. That does 
not mean providing students automatically with all the metrics on their academic process, but it does 
mean doing so if the student requests such information. 

Students should be able to access all learning analytics performed on their data in meaningful, 
accessible formats, and to obtain copies of this data in a portable digital format. Students have a 
legal right under the DPA to be able to correct inaccurate personal data held about themselves. 

[...] They should normally also be able to view the metrics and labels attached to them. If an 
institution considers that the analytics may have a harmful impact on the student's academic 
progress or wellbeing it may withhold the analytics from the student, subject to clearly defined 
and explained policies. However, the student must be shown the data about them if they ask to 
see it. 

5.7 Enabling Positive Interventions 

As with the other sections, this one reflects concerns expressed in the literature. The frequently quoted 
"obligation to act" for both institutions and students (e.g., Campbell, DeBlois, & Oblinger, 2007; Kay, Korn, 
& Oppenheim, 2012; Willis & Pistilli, 2014) is covered, as are the main potential pitfalls of intervening 
directly with students based on analytics. 

Institutions should specify under which circumstances they believe they should intervene when 
analytics suggests that a student could benefit from additional support. This may include advising 


ISSN 1929-7750 (online). The Journal of Learning Analytics works under a Creative Commons License, Attribution - NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) 


34 


JOURNAL OF LEARNING ANALYTICS 


S8LAR 

SOCIETY for LEARNING 
ANALYTICS RESEARCH 

(2016). Developing a code of practice for learning analytics. Journal of Learning Analytics, 3(1), 16-42. http://dx.doi.Org/10.18608/jla.2016.31.3 

students that they should not continue on a particular pathway. Students may also have 
obligations to act on the analytics presented to them — if so these should be clearly set out and 
communicated to the students. 

The type and nature of interventions, and who is responsible for carrying them out, should be 
clearly specified. Some may require human rather than digital intermediation. Predictions and 
interventions will normally be recorded, and auditable, and their appropriateness and 
effectiveness reviewed. 

The impact of interventions on staff roles, training requirements and workload will be considered 
and requires support from senior management. Institutions will also be clear about the priority 
given to learning analytics in relation to other requirements. 

Institutions will decide how to allocate resources for learning analytics appropriately for learners 
with different requirements and ensure that diverse groups and individuals are treated equitably. 

5.8 Minimizing Adverse Impacts 

Some of the reservations frequently expressed in discussions and in the literature are covered here. For 
example, analytics should not treat an individual as a number, and institutions should be careful not to 
prejudice students' chances by categorizing them (Campbell, DeBlois, & Oblinger, 2007; Greller & 
Drachsler, 2012). There are also potential detrimental effects when student progress is being analyzed, so 
these need to be understood and minimized. MacCarthy (2014) points out that the algorithms used for 
learning analytics may reinforce discriminatory attitudes, while Swenson (2014) suggests that 
interventions might favour one group over another (for example, campus based over distance students). 

Institutions recognize that analytics can never give a complete picture of an individual's learning 
and may sometimes ignore personal circumstances. 

Institutions will take steps to ensure that trends, norms, categorization or any labelling of students 
do not bias staff, student or institutional perceptions and behaviours towards them, reinforce 
discriminatory attitudes or increase social power differentials. 

Analytics systems and interventions will be carefully designed and regularly reviewed to ensure 
that: 


• Students maintain appropriate levels of autonomy in decision making relating to their 
learning, using learning analytics where appropriate to help inform their decisions 

• Opportunities for "gaming the system" or any benefit to the student from doing so are 
minimised 

• Knowledge that their activity is being monitored does not lead to non-participation by 
students or other negative impacts on their academic progress or wellbeing 

• Adverse impacts as a result of giving students and staff information about the students' 
performance or likelihood of success are minimised 

• Staff have a working understanding of legal, ethical and unethical practice. 
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5.9 Stewardship of Data 

Finally, a section was included to remind institutions of their responsibilities to look after student data 
carefully. European legislation does cause a potential restriction here on the use of Big Data for learning 
analytics: the uses to which the data can be put are often not known in advance, so minimizing the data 
that is kept, and destroying it after a period, might restrict institutions' abilities to obtain valuable insight 
on student behaviour. However, institutions do need to comply with the legislation and should arguably 
obtain additional consent from students if they wish to retain their data for longer periods. 

Data for learning analytics will comply with existing institutional data policies and the DPA, and will 
in particular be: 

• Kept to the minimum necessary to deliver the purposes of the analytics reliably 

• Processed in the European Economic Area or, if elsewhere, only in accordance with the 
DPA 

• Retained only for appropriate and clearly defined periods 

On request by students any personal data used for or generated by learning analytics should be 
destroyed or anonymised, with the exception of certain, clearly specified data fields required for 
educational or statutory purposes such as grades. 

6 A MODEL FOR THE DEVELOPMENT OF A CODE OF PRACTICE 


Others have wrestled with how best to develop a code of practice. The Institute for Business Ethics (IBE, 
2015) and the International Federation of Accountants (PABC, 2007) each suggest a number of broadly 
similar steps to be taken in the development of a code of ethics or a code of conduct. While relevant, 
these relate to the development of a code for a single institution rather than an educational sector or 
profession. Table 2 summarizes these steps and shows how they have been implemented in the 
development of Jisc's sector-wide Code of Practice. 


Table 2: Actions taken to develop the Code of Practice. 


Proposed step 

Gain the commitment of 
senior management 


Action taken to develop the Code of Practice 

In this case, “the commitment of senior management" is analogous to 
the prioritization by the further and higher education community in the 
UK that the ethical and legal issues of learning analytics needed to be 
addressed as a matter of urgency. 


Find a champion and set up 
a committee to oversee 
development and 
implementation 


A consultant was employed to lead the development of the Code, and an 
advisory group with expert representation from the sector was set up. 


Identify stakeholders, what 


The advisory group was appointed, consisting of experts from 
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is important to them, and 

who should be involved in 

code development and 
implementation 

universities and colleges, and a student representative from the National 

Union of Students. 

Agree on the purpose of the 

code and how it will be used 

The advisory group decided on the approach to producing the Code, the 
areas to be covered, ways to gain further validation from the community, 
dissemination, and adoption. 

Review existing external and 

multi-sector conduct 

guidelines 

The literature review identified key aspects of guidelines and codes in 
related areas, as well as summarizing the main ethical and legal issues of 
learning analytics arising in the literature. 

Draft the content, perhaps 
by a working group 
comprising representatives 

from various functions in an 

organization 

The taxonomy of issues was developed with assistance from Apereo and 
Lace. This provided the basis for the Code drafted by the consultant and 
refined by the advisory group. 

Test, pilot, and approve the 

code 

The advisory group approved the Code; testing and piloting in 
institutions is ongoing. 

Publish and publicize it 

The Code was launched at a prominent event, published on the Jisc 
website, and disseminated heavily. 

Review the code and its 

impact, taking into account 
changing requirements and 

stakeholder concerns 

This will happen once the Code has been adopted by a number of 
institutions. Some are already reporting the influence it is having on the 
development of internal learning analytics policies. 

Provide training and 

communication as a means 

to embed the code 

Conference presentations and workshops are encouraging the Code's 
adoption by institutions. Support materials, including a series of 
podcasts, have been developed for the accompanying website. 

Connect the code to the 

organization's (a) 
performance management 
policies and systems, and (b) 

internal controls 

This crucial step is beginning to happen as institutions develop their own 
codes that build on Jisc's documents and link to other internal policies. 
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The activities involved in the production of the Code of Practice for Learning Analytics potentially provide 
the basis for a generalizable model for developing codes of practices in other professions or areas of 
education. An outline of the model is provided in the diagram shown in Figure 2. 



Figure 2: A model for the development of a code of practice. 

Five products are developed during this process. First, a literature review (1) captures the main ethical, 
legal, and logistical concerns being raised. At this point, an advisory group is recruited, bringing in 
expertize from the sector and representing key stakeholder groups. The advisory group can continue until 
the code is published or could be retained on an ongoing basis to ensure that the code and supporting 
website remain relevant. It could even be set up earlier to guide the production of the literature review, 
if necessary. 

The literature review informs a taxonomy of issues (2), which is refined through expert consultation in 
the sector. The draft code of practice (3) is then produced and sent to experts and stakeholder groups as 
part of a public consultation for a fixed period. Feedback is incorporated into a final code of practice (4) 
document, which is released publicly both online and through associated events if appropriate. A 
supporting website (5) is populated with further guidance and case studies. As institutions pilot the code 
of practice, they provide feedback and suggested enhancements that can be fed into a new draft for an 
updated version of the code at a later stage. 

The model requires a number of factors to be in place in order for it to be effective; some of these may 
be problematic in other sectors or industries: 

1. An established literature base outlining the issues of concern 
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2. Organizations wishing to contribute, and to be part of a representative advisory group, regarded 
as credible by the sector 

3. Communication mechanisms enabling adequate consultation with the sector 

4. Institutions willing to pilot the code of practice and provide feedback for its enhancement 

5. An ongoing commitment to reviewing and updating the document in order to ensure it remains 
relevant 

In addition, organizing the development of a code of practice will require financial input and time 
commitment from representatives. It is hoped that the iterative aspect of the model outlined above will 
be tested by the development of a version 2.0 of the Code of Practice for Learning Analytics once 
institutions have provided further feedback on its usefulness and limitations. While this model may not 
be appropriate for the development of other codes of practice in its entirety, the various products and 
stages have helped to ensure that the Code was rigorously researched, widely consulted on, and well 
disseminated. These factors should assist with its adoption in institutions, or at least with raising 
consciousness about the issues that need to be tackled at the organizational level. 

7 CONCLUSION 

The Code of Practice for Learning Analytics produced by Jisc covers the main concerns for students and 
institutions that commonly arise in the literature and in discussions. The rigorous and consensual 
approach to developing the document through its various stages aims to help ensure its adoption. The 
draft Code was sent to a wide range of educational organizations and received much detailed feedback, 
most of which was incorporated. Much of this attempted to tidy up ambiguities in the wording, 
particularly where it related to legal issues. The final version was released at an event in Salford in June 
2015 (Sclater, 2015d) and received much interest online. 

The primary purpose of the Code is to help institutions deal with ethical objections and legal uncertainties, 
and to facilitate the further development of the field of learning analytics. The document's brevity and 
the clear language and formatting employed aim to encourage people to read it and to grasp quickly the 
most salient issues. Adoption of the Code by institutions and their employees and students, however, is 
by no means guaranteed, and agreeing with the document is of course much easier than applying it to all 
necessary areas of institutional business. Its main value may be in raising the issues and providing a 
checklist for institutions to consider; ultimately, it is their responsibility to apply its principles to their own 
activities, to embed the concepts in their policies as appropriate and to ensure that these are 
implemented effectively. 

Promising signs of its influence are already emerging. The National Union of Students has produced a 
guide for students' unions that builds on the Code of Practice and links to it (NUS, 2015). The UK's Higher 
Education Academy outlines the eight areas of the Code in its Learning Analytics Toolkit (HEA, 2015). 
Meanwhile the University of Edinburgh links to the Code in its emerging "Guidance on learning analytics 
and data protection" and suggests that it is "a good starting point for staff in identifying relevant issues 
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and how to address them, to ensure that learning analytics is carried out responsibly and effectively" 
(University of Edinburgh, 2015). 

The Code was developed in the UK context and refers to the Data Protection Act 1998. However, most of 
it is relevant to institutions wishing to carry out learning analytics anywhere, particularly in other 
European countries with similar data protection legislation. The development and release of the 
document has been of considerable interest elsewhere, notably in the USA, Australia, and the 
Netherlands. In the latter, a "Guide to Learning Analytics underthe Personal Data Protection Act," building 
on Jisc's work, has been published (SURF, 2015). 

While its reception has been overwhelmingly positive, one USA-based vendor, commenting on a publicly 
available draft of the Code, felt that it put unnecessary restrictions on institutions and would thus hold 
back the development of learning analytics. This is precisely the opposite of what is intended. The lack of 
a code of practice for learning analytics has been paralyzing many institutions, preventing them from 
moving forward and hampering the development of a critical set of technologies and processes with 
potentially significant impacts on the lives of individual learners. Clarifying the issues and proposing 
transparent, ethical solutions that comply with strict data protection legislation should help to break the 
deadlock and enable the further development and rollout of learning analytics. Interest has been 
expressed in adapting the document for use in the Netherlands and France. Meanwhile, several UK 
universities have already indicated that they will use the Code as the basis for their institutional policies 
on learning analytics. 

The supporting website is currently being developed and will include case studies and more detailed and 
practical guidance for institutions on how to deal with the problems they encounter. As Jisc rolls out its 
basic learning analytics solution to UK institutions (Sclater, 2015c), experience of local implementations 
will be captured and fed into the guidance, together with examples of how institutions elsewhere in the 
world have dealt with ethical and legal barriers. 
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